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Abstract 

The Physarum solver [31, 18] is an intuitive mechanism for solving op- 
timisation problems. The solver is based on the idea of a current reinforced 
electrical network, whereby the conductivity a(t) 6 R+ is reinforced by 
the current or flow, 4>(t) £ R+. In this paper, we show how the Physarum 
solver obtains the solution to the linear transshipment problem on a di- 
graph G — (V, E). We prove that the current <f)(t) and a(t) converge with 
an exponential rate to a positive flow minimising £(<j>) — Y^ij tij(j>ij- The 
limit flow has full support on the optimal set H. If we assume that H is a 
connected subgraph, the electrical potential vector p(t) g R v converges to 
a solution p* of the dual problem which is a discrete oo-harmonic function 
([14, 25]) defined on the vertices of a subgraph H* which in many cases 
is a spanning subgraph, i.e. V(H*) = V(G). 

1 Introduction 

Many biological systems solve problems in a decentralized manner. As a leading 
example, path-finding by Physarum polycephalum (a giant amoeba of true slime 
mold) is well studied. Physarum can find the shortest path in a maze and the 
risk-minimum path in the inhomogeneous field of risk [20, 21, 22]. On the basis 
of experimental work, a differential equation model of such path minimisation 
has been proposed [23, 19]. The model is based on the idea of a current rein- 
forced electrical network. As current or flow increases through a medium the 
conductivity is increased. 



The Physarum solver has been primarily studied by numerical simulation. 
Indeed, the algorithm was extended in order to make it applicable to a wider 
range of problems concerning the optimal design of networks, e.g. the short- 
est network problem [29] and multi-objective optimisation [30, 32]. Numerical 
simulation shows a good performance in problem solving and a correspondence 
to some interesting characteristics of the biological system [ ]. Onishi et al. 
have published a few papers on the rigorous analysis of the Physarum solver 
[16, 18, 17]. The work is pioneering and just at the beginning. 

A mathematical description of the Physarum solver is as follows. We consider 
a weighted directed graph G = (V,E,£), where the positive weights £ij > are 
interpreted as lengths of the arcs ij G E. For the physarum solver the candidate 
flow <f>(t), t > 0, is obtained as an electric current in an electrical resistor network 
obtained from an adapting positive conductivity vector a(t) — (<7y(t)), t > 0. 
We apply fixed external current sources, described by a fixed source vector 
b = (pi) which defines the flow requirements, and we obtain from a(t) the 
current <f>(t) = (<j>ij(t)) and potential pit) = (pi(t)) using Kirchhoff's laws. The 
physarum solver is then completely specified by updating the conductivities 
according to the recipe 

^ij(t) + <Tij(t) = (pij(t). (1) 

We can arbitrarily choose the initial state cry(0) > 0, for all ij G E. We show 
that 4>(t) converges at an exponential rate to a positive flow <f> that minimises the 
cost := J2ij V-ij4>ij ■ I n [5] and [15] minimum cost flow problems are solved 
using electrical networks with non-linear resistors. In contrast, the Physarum 
Solver works by modifying networks with ordinary linear resistors. 

In this report, we state a couple of theorems and proofs regarding the algo- 
rithm by means of mathematical analysis. Using the above model, we obtain a 
more general result than that obtained in [18] which gives the convergence for 
certain shortest-path problems in planar graphs. As stated above, we show con- 
vergence to a solution of the transshipment problem [28] for the given weighted 
digraph. One consequence is that the shortest path in a maze is certainly 
obtained and the analysis indicates additional utility and performance of the 
algorithm. 

We also show that p — \xmp(t) converge to a canonical dual solution in the 
form of an oo-harmonic function, which, generally, is defined outside the node 
support of the minimum flows. Discrete infinity-harmonic functions have been 
introduced in [14, 25] as value functions for certain type of games. (Our defini- 
tion of discrete oo-harmonic functions is slightly different for directed problems 
and take into consideration the direction of the arcs in another way.) The dis- 
crete infinity-laplacian is highly non-linear, but here we obtain the harmonic 
solution as a limit using solutions of the ordinary linear laplacians L(o~(t)). 

What perhaps makes the Physarum solver stand out as an algorithm is that 
its implementation is physically immediate; the computation relies on physi- 
cal quantities like conductivity, potential and flow, which are present for many 
natural systems; in particular, they can be derived from underlying diffusion 
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processes. This should make the Physarum solver a candidate for a general 
description of how optimal transport is handled in nature. It should also be 
considered as a possible basis for decentralised computer algorithms for mathe- 
matical programming. We discuss briefly these issues in Section 2. 

1.1 Preliminaries 

A vector tfi £ K" 4 is a real-valued functions on the finite index-set A. We write 
x = {x a ), a e A. The support suppx is the set of a where x a ^ 0. Arithmetic 
operations and relations between vectors should be interpreted component- wise, 
for example xy 2 jt < z should mean the vector (x a y\li a < z a ). Scalars are 
interpreted as constant vectors of appropriate dimensions when needed. We re- 
strict the domain of vector x to B C A by writing x\b or x\b- The characteristic 
function for a set S C A is denoted Is- When using matrix- algebra, all vectors 
are column vectors and the corresponding row- vector is denoted by x T . For a 
vector x = (x a ), we use \x\ to denote the vector (|x Q |). We use x + and x~ 
to denote the positive and negative parts, respectively, so that x = x + — x~ 
and \x\ = x + + x~ . The norm ||a;[| is used to denote the ^i-norm of x, i.e. 
IMI = Ea \ x a\, an d the norm ||x||oo is the maximum norm \\x\\oo = max Q \x a \. 

The language from graph theory is hopefully standard. However, we consider 
mainly directed graphs G = (V, E) without loops and multiple edges. The term 
graph will usually mean such digraphs. Elements of V are called nodes (or 
vertices) and are denoted i,j,k,l etc.; the elements of E C V x V are called 
directed arcs (edges) and are denoted ij kl, etc. For the arc ij, i is the tail 
and j is the head of the arc. We sometimes write \G\ for the number of edges 
|J3(G)|. The underlying undirected graph of a digraph G is denoted by U(G). 
An oriented subgraph H of G is a digraph H such that U(H) is a subgraph of 
U(G). An oriented graph corresponds with a vector £ H £ {0,1,— 1} E , where 
£h = 1 if ij £ H, —1 if ji £ H and zero otherwise. The oriented subgraph H 
is thus a directed subgraph if £ H — 1e(h)- A s oriented subgraphs goes, we will 
mainly deal with oriented paths, oriented cycles and oriented cuts (cut-sets) of 
G, and if the corresponding subgraph is a sub-digraph of G we talk of a directed 
cycle, path or cut in G. 

We use standard asymptotic notation. Thus g = f2(f) means liminf |g|/|/| > 
0, g = O(f) that limsup |g|/|/| < oo and g — o(f) that limsup |<?|/|/| = 0, as 
the relevant limit is taken. 

1.2 The transshipment problem 

In a discrete setting the transshipment problem has the formulation of a min- 
imum cost flow problem on a directed connected graph G — (V, E) without 
upper capacities and positive linear costs. A flow (or a b-flow) is an arc-vector 
4> = (<fiij)ijeE £ R B that satisfies, for all nodes i £ V, KirchhofFs Current Law 




(2) 
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The source vector is the node vector b £ MX obtained as the prescribed net 
out-flow at nodes. We assume that J2i °i — 0- If &* > we say i is a supply 
node (or source) and if bi < a demand node (or sink). A flow is positive if 
4>ij > 0, meaning that the flow goes in the direction of the arcs. The cost is a 
positive linear function on flows 

ij&E 

The cost coefficients > will be referred to as lengths prescribed to the arcs. 

The transshipment problem is to minimise the cost among all positive flows. 
It can be shown (see e.g. [28, 33]) to be equivalent to the more general minimum 
cost flow problem and subsumes among others the shortest path problem and the 
minimum cost assignment problem. An undirected problem is a problem without 
the positive flow constraint, with cost function £(|^>|). It can be mapped to an 
equivalent transshipment problem if we replace each arc with a pair of arcs in 
both directions. 

For the given directed graph G = (V,E), let B = B G £ WL VxE denote the 
boundary operator to G, i.e. the matrix given by 

!— f if i is the head of arc e 
+1 if i is the tail of arc e 
if i is not incident with e. 

The linear transshipment problem can be stated quite effectively using the ma- 
trix B, i.e. 

minimise z — £ T (j), where B<p = b and 4> > 0, (3) 

For the given source vector b £ MY , we denote the affine space of corre- 
sponding flows by $ = <!>(&, G) C M°. The convex polyhedron of positive flows 
is denoted by $+ = $+(6, G), i.e. $+ = {cp £ MP : B(f> = b, > 0}. The target 
for the Physarum Solver is to reach the set of flows cj) £ $ + where the cost 
t{4>) is minimum. Since I > 0, this makes up a convex polytope (i.e. a bounded 
polyhedron) $ = $(b,G,£). 

A cut is a partition (S, V \ S) of V in two parts and the corresponding 
oriented cut is given by the vector n s := B T ls £ { — 1,+1,0} E . Given a flow 
4> £ $(6, G), it holds that for any cut k — k s the net flow k j '<f> equals 

b(S) :=b T l s = Y, b * = - E b *- W 

ies iev\s 

The transshipment problem (3) is feasible, i.e. $ + ^ 0, if and only if, for every 
S £V with b(S) > 0, there is some arc from S to V \ S. 

A negative cost cycle is an oriented cycle 7 £ {0, 1, — 1} E such that the cost 
£(7) < 0. That a flow tj> £ <£>+ admits an augmenting cycle 7 means that the 
flow x + £7 is feasible, i.e. positive, for some scalar 5 > 0. It is well known 
(e.g. [ ]) that a positive flow is of minimum cost if and only if it admits no 
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augmenting negative cost cycle. Since the problem (3) does not have any upper 
capacities, a positive flow </> £ < & + belongs to 3> if and only if for every negative 
cost cycle 7 there is some arc ij such that jij = — 1 and <£y = 0. 

From linear programming theory [ 2] , we obtain that the dual problem cor- 
responding to (3) is 

maximise w = p b, where B T p < £ (5) 

for the dual variables p = (pi) £ MX . In the physarum solver, the dual variables 
Pi, i £ V, are interpreted as potential values in the electric network. It is the 
cocycle of potential differences, B T p = (pi — pj)ij^E, that carry all information 
and p £ MX will only be determined up to a constant. The cocycle space is 
the range of B T : M. v —> R E and constitutes the orthogonal complement to the 
cycle space $(0, G) with respect to the standard inner product (x, y) — > x T y on 
M. E . Elements of the cycle space are also referred to as circulations. 

Instead of working with cocycles, we mainly use the corresponding fields 
( "electrical field strengths" ) , or slopes, by which we mean vectors ip £ M. G such 
that £tp is a cocycle on G. In other words, fields are vectors of the form 

Pi - Pj I 

Notice that, the constraint in (5) can be written ip < 1. Fields and cocycles 
are for our purposes equivalent entities and the potential can be recovered, as 
Pi = Pk+£(ipTr), where ir is any oriented path from the (fixed) vertex k to vertex 
i. 



i> = := (B T p)/£ = 



1.3 The non-symmetric physarum solver 

Given a transshipment problem specified by (G, b, £) as above, an electrical net- 
work is specified by the positive conductivity a = (uy) £ The conductance 
vector is then a jl and the resistance vector is given by £/a. Kirchhoff's equa- 
tions can be stated using the weighted graph laplacian 

L{a) := BGB T , 

where G = diag(er/^) £ R ExE is the diagonal matrix with the conductance 
vector a/£ along the diagonal. In our setting, Kirchhoff's equations amounts to 
finding a solution p £ M. v to the discrete Neumann problem 

L(a)p = b (6) 

A solution p gives the flow (the current) <f> via Ohm's law 

, Pi - Pj , 

<t>u = a a — p — = ^j^) ( 7 ) 

where 

r/i = = B T p/£. 
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In the Physarum Solver, we consider an electrical network which evolves 
through "time" t G [0, oo), where the state is specified by the corresponding 
time- varying conductivity vector <r(t) G R^. We let <p(t) G M. E and p{t) G 
M. v denote the corresponding current and potential, which are derived from 
G, b, I and a(t) by solving Kirchhoff's equations. The current (j>(t) will at all 
times constitute a flow in $(&, G), but not necessarily a positive flow, nor will 
the potential vector p(t) automatically be feasible for the dual problem. Since 
supper(t) = G which is connected by assumption, we can make the vector p(t) 
unique by stipulating that its lowest value is zero. 

In this paper we use a version of the Physarum Solver, where the conductivity 
vector <r(t) = {&ij{t))ij£E is updated according to the non-linear equation 

^0fc(<) + *■«(*) = &i(*)- (8) 

We can arbitrarily choose the initial condition as long as <Jij(0) > 0, for all 
ij G G. For fixed a(0) > 0, £ and b, in this paper, we refer to the electrical 
network obtained by letting cr(t), evolve, for t > 0, according to (9), as the 
Physarum Solver. Ohm's law (7) immediately gives the following alternative 
form of (8) 

^log<r(t)=V(t)-l, (9) 

where ip(t) := * (p(t)). 

The "non-symmetric" physarum solver defined by (8), or equivalently by (9), 
is different from the previous symmetric solver, presented in [31] and analysed 
in e.g. [18], where \tp(t)\ — 1 and \4>%jif)\ was used on the right hand sides 
of (9) and (8), respectively. The use of a non-symmetric conductivity vector 
o~ij{t) is perhaps somewhat surprising; in an electrical network, conductivity 
and conductance works symmetrically at a fundamental level. If we have a 
double (undirected) arc {ij,ji}, the electrical network will have an effective 
conductivity er^ + Uji across the corresponding arc and the flow across the two 
arcs will be proportional to these conductances. The two terms will not evolve 
identically; if the flow is from i to j consistently then the conductivity Uji in 
the opposite direction will be of order 0(e~ t ) as t — >• oo. 

1.4 Duality analysis 

The convergence of the physarum solver to an optimal flow can be discussed 
in the context of primal-dual methods (see [12], [3]) to solve mathematical pro- 
gramming problems. By the Theorem of Complementarity of Slackness ([12, 
Theorem 13.4]), a primal-dual pair of feasible solutions (p,(f>), corresponds to 
optimal solutions of the dual and primal problems, respectively, precisely when 

(^•-1)^ = 0, VijeE, (io) 

which means that, for each arc ij G E, the points (ipij , tfiij) lie on the broken 
"in-kilter line" {0} x (— oo, 1] U [0, oo) x {1} depicted in figure 1. This illustration 



G 




in-kilter line" 



Figure 1: The mechanism in the physarum solver as a primal-dual algorithm 
explained in a kilter diagram: If 4>%j > &ij the conductivity <Jij(t) increases, 
from time t to t + dt, by a factor 1 + dt(ipij — 1). 



of duality is used in e.g. [5] [15], where it is showed that a non-linear resistor 
network having the kilter-line as a "characteristic curve" for the resistor along 
edge ij will produce a current that solves the corresponding minimum cost flow 
problem. 

For the linear resistor networks used in the Physarum Solver, Ohm's law, 
(7) ensures that the point (<j>ij , ipij) is on the line going through the origin and 
the point (crjj,l). The optimality criterion (10) can therefore be reformulated 

as 

ip < 1 and (j> = a. (11) 

The dynamics of the physarum solver increase the logarithm of conductivity if 
ipij > 1 and make it decrease if ipij < 1. From this, we obtain the following 
observation. 

Proposition 1. Any attractive fixed-point for the Physarum Solver must cor- 
respond to a primal-dual pair (4>,ip) where, for all ij £ E, (<fiij , ipij) lie on the 
kilter line: ipq = 1, if 4>ij > 0, and ipy < 1 if 4>ij — 0. It will thus correspond 
to an optimal solution of the primal problem (3) and the dual problem (5). 

1.5 The primal convergence theorem 

However, it remains to show that <7ij(t) actually converges to some attractive 
fixed point. The optimal set is the subgraph H of G induced by arcs supporting 
some minimum cost flows, i.e. 

H = G[U{supp/:/e$(6,G)}]. 

By the characterisation of optimal flows and the convexity of $, H only support 
zero-cost cycles and it follows that a positive flow is optimal precisely if it's 
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support is contained in H. 

Theorem 1. Assume that that the stated problem (3) is feasible. Then the 
current cf>(t) converges exponentially fast to some optimal flow </>£$, i.e. <j){t) — 
(^±e - l fi ^L The limit flow (f> has moreover full support, i.e. supp</> = _ff. 

Note that, the fact that the Physarum Solver converges to a flow with full 
support on the optimal set puts it on par with interior point methods (see e.g. 
[26]) in linear optimisation. Although there are some similarities, the Physarum 
Solver seems to be distinct from interior point algorithms: For instance, neither 
the current 4>{t) nor the potential p(t) are supposed to be feasible solutions to 
(3) and (5) and are not interior points in this sense. In section 2, we briefly 
discuss possible extensions of the Physarum Solver to more general linear and 
non-linear optimisation problems. 

1.6 Infinity harmonic functions and the dual convergence 
theorem 

Given a directed graph G = (V, E) and a subset S £ V, we say that a potential 
p £ R^ with corresponding field ip = ^(p), is a discrete oo-harmonic function 
on G \ S, if for all i £ V(G) \ S, we have 

max ibki = max tba > (12) 
k:kieE r-ijeE 

We can restate this condition as follows: Consider the level sets F r := ^ _1 (r), 
T > 0, of the field ip = ^(p) and define 

H r :=U s>r F s ((r,oo)) . 

Then p is co-harmonic on F U H \ S if and only if, for all r, F r is a union of 
directed paths with endpoints contained in S U V{H r ). 

Discrete functions satisfying (12) have been studied [14, 13, 25] as values for 
stochastic two-person games which are symmetric in a certain sense. The results 
in [25] concerns the more general concept of length spaces. Our definition above 
is a little bit different, since we take the maximum over in-going and outgoing 
arcs in (12), separately. For the undirected problems, i.e. digraphs G — {V,E) 
where ji £ E whenever ij £ E, the definitions are equivalent. 

Since all oriented cycles in H have zero cost, it follows that ip = £^ is a field 
on H . The following lemma is an adaptation of Theorem 12 in [13]. For A > 0, 
let 

Lemma 1. Assume that H is connected and that p £ R 17 ^' is the potential 
on H given by ^E'(p) = £ H and minp = 0. Then there is a unique extension 
p* £ R y ( ff *) of p, where H £ H* £ G, such that Pjy^jj*) is oo-harmonic on 
H* \ suppfr. It is the unique such extension that maximises 

s( P *,H*,A) ^^Ti^rVM'. 
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for all sufficiently large A. Moreover, p* is dually feasible for (5), i.e. ^(p*) < 1 
for all arcs ij 6 G. 

We defer the precise construction to section 3.3. However, it should be noted 
that, if G is connected and comes from an undirected problem, i.e. if all arcs 
comes in pairs of 2-cycles, then H is connected and V(H*) = V(G). Notice 
also that H is connected if, for all S C V such that the symmetric difference 
S A (supp b) ^ 0, we have b(S) ^ 0; in particular, this holds for a generic source 
vector b. 

The following theorem states that p(t) converges to a oo-harmonic function 
defined on H * . 

Theorem 2. Assume that H is connected and (3) is feasible. Then 

\\p(t)\v(H-)-p*\v( H *)\\oo=e-\ Q U\. 
where p* H , is the unique oo-harmonic extension of p obtained in Lemma 1. 

The connection between discrete oo-harmonic functions and dual solutions of 
the transshipment problem has, as far as we know, not been noted elsewhere. For 
the shortest path problem between a source s and a sink t, Dijkstra's algorithm 
construct a canonical limiting dual solution given by the distance functions to 
s (or t). The oo-harmonic dual solution p obtained is, in contrast to these 
solutions, symmetric under the symmetry of "time-reversal" , i.e. if we change 
the sign of B, b, we obtain a new solution — p + const. In continuous theory, 
the relation between transport problems and the Neumann problem for the oo- 
laplacian has been noted e.g. in [9], but, as far as we understand, then only 
defined on the transport set of optimal flows. The physarum solver, if it can 
be extended to the continuous setting, would perhaps be interesting for such 
problems. 

1.7 Feasibility detection 

The physarum solver will detect an infeasible problem fairly quickly. We state 
the following proposition without proof. 

Proposition 2. If the problem (3) is infeasible then ||p(i)||oo — ► +°° before 
time to for some constant to = to(b,£,a(0)). Otherwise, if the problem (3) is 
feasible then there is a constant p max > such that ||p(t)||oo <Pmax- 

2 Discussion 

2.1 General costs and general linear programs 

The duality analysis stated in Proposition 1 remains valid for the more general 
class of linear programs of the form (3) given by more general coefficient matrices 
B = A and linear cost £((f>) = £ T cf) where I > 0. That is, provided the laplacian 
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matrix L(a) = BGB T is well behaved and provides a solution, any stable fixed- 
point to (8) should correspond to an optimal solution and vice versa. Although 
the proof in the next section uses arguments specific to graphs, one can hope 
to extend the applicability of the Physarum Solver to a larger class of linear 
programming problems. 

Proposition 1, can also be generalised to more general convex costs, i.e., 
flows where the cost C(</>) is a convex increasing function of the flow (f> > 0. 
(See e.g. [15] or [8].) In the argument one should then substitute £ with the 
gradient V^C^) > 0. However, as is well known, arguments based on duality 
breaks down for concave costs; these problems are in general NP-hard [10] and 
contains, e.g. the famous Steiner tree problem on graphs. The actual models [ ] 
of the physarum organism use non- linear functions |0ij| 1+7 , 7 > 0, on the right 
hand side of (8), to fit empirical data. It may be taken as an heuristic method 
for the minimisation with increasing concave costs. The Physarum organism 
seems to do quite well solving simple Steiner problem [29], which partly can be 
explained by such concave cost minimising. 

2.2 Efficient implentation of the physarum model 

In this paper, we have not analysed the physarum solver as a computer algo- 
rithm for transport problems. Thus we make no assertions about the time or 
space complexity of an eventual computer implementation. However, some ob- 
servations regarding its eventual place among existing algorithms can be made. 
It is clear that the physarum solver does not rely on any centralised synchronous 
computation and, assuming that the map that takes the conductivity vector to 
the corresponding current vector and vector of potential differences is provided 
by the environment, it is readily implemented from local dynamics with simple 
rules. 

The one important algorithmic complexity in the physarum solver as defined 
here is the cost of solving Kirchhoff's equations for a given conductivity vector. 
There are certainly efficient and localised solvers for Kirchhoff's equations for 
general weighted laplacians (see e.g. [2' ]). However, it may be more elegant and 
perhaps ultimately more efficient to side-step this issue by using the well-known 
([7] or [11]) relations between random walks on weighted graphs and electrical 
networks. As such, the physarum solver could be implemented in an entirely 
decentralised manner as a reinforced random walk. There are algorithms for the 
minimum cost flow problem, like the various auctions algorithm by Bertsekas 
et. al. (see [1 1 ]), that allows for being implemented asynchronously and in parallel. 

The physarum solver seems quite similar to the variant of Baum's algorithm 
[1], the "knee-jerk algorithm", used in [4] to compute resistive inverses in elec- 
trical networks — if the obtained voltage over an edge is too large or small, we 
increase or decrease the conductivity, quite oblivious of global considerations. 
It would be nice to know if it is possible to find a similar interpretation for the 
physarum solver. This could possibly lead to faster implementations allowing 
for optimal steps in the basic iterations. 

Another motivation for studying a randomised physarum solver is to model 
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biological systems. A randomised physarum solver can take many forms, for 
example as an "ant algorithm" with positive reinforcement of walks. It should 
be noted that, unlike the prototypical edge- reinforced ant algorithm [(>], the ran- 
domised distributed physarum solver should update conductivities according to 
the net transport rather than total transport across arcs. In a forthcoming 
paper, we plan to investigate the possibilities of different distributed implemen- 
tations of the physarum solver using the random walk connection. Indeed, the 
physarum solver can be used as a unifying model for several biological transport 
systems among them foraging ants and, of course, the physarum organism. 



In this section we prove Theorem 1 and Theorem 2 and is divided in several 
subsections. We start stating a couple of lemmas, including Lemma 5 and 
Lemma 4, concerning the continuity of Kirchhoff 's equations and the existence of 
solutions having constant field-strength locally. The construction of the infinity 
harmonic dual solution is made in section 3.3. Finally, we prove Theorem 1 and 
later we prove Theorem 2 by induction, using the result from Theorem 1 as the 
base case. 

3.1 Some facts and lemmas 

Recall that, for S C V, b(S) is the required net flow across the cut E(S, V \ S). 



Let b* max = max s \b(S)\ and let b* min = min{|6(5)| : b(S) ^ 0}. The following- 



elementary lemma states that if the total flow across a set of arcs is small enough 
we can find a nearby flow avoiding those arcs. 

Lemma 2. Let <f> G $ be a given flow and let E' C E be a set of arcs. If 



then there is a flow <f>' 6 $ with support supp <p' C supp <p\E' and such that 

Moreover, 4>ij4>'ij > f or a ^ ij £ E, so the flow <f>' is in the same direction as 
that given by <j>. 

Proof of Lemma 2. It is enough to show this for the case \E'\ — \{ab}\ = 1, 
the general case follows easily by induction. We can assume that the flow <j> is 
positive, since we can reorient the graph G without changing the statement of 
the lemma. 

Let therefore / = 4> ~~ 4>ab ■ lab where 4>ab — w > 0. We intend to repair / 
by constructing a a6-flow S of value w such that f = f + 8 docs not change the 
orientation of any arc. By the Max-Flow-Min-Cut Theorem and Theorem 4.3 
in [12], this flow problem can be solved with ||5||oo < w unless there is an cut 



3 The proofs 




ij£E> 
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(S, V\S) in G separating a £ S and b £ V \ S with the following properties: 
Firstly, no arc in G, except ab goes from S to V \ S. Secondly, the capacity of 
the cut, which is given by c := Y^iev\S jeS sa ti snes c < w - 

Hence, for the original flow cf>, the flow goes from V \ S to S for all arcs 
in the cut except for the arc ab. Since the net flow of <f> across the cut equals 
c — w < b* min , we can conclude that b(S) = 0. But then c = w contradicting the 
existence of the cut. □ 

The set T of basic feasible solutions (bfs) are positive flows with support on 
directed graphs without oriented cycles, i.e. the underlying undirected graphs 
are forests. For a r £ T, removing an edge ij from the support of r results in a 
graph with two new components and r-y = b(S) > 0, where <S* is the component 
containing i. Hence, we have 

b* min < Uj < b* max , Vij £ suppr. (13) 

A positive flow <f> £ <I> + is circulation free if it is supported on a subgraph 
without a directed cycle. A circulation free positive flow </> with minimal edge 
support is a bfs; if 7 € { — 1, +1, 0} is an oriented cycle with supp7 C supp</> 
then <j)' = <f> — o?7 is a positive circulation free flow with supp <f>' C supp <f> for 
a = mm{(f)ij 4 - : 7~y > 0}. It follows that, for any circulation free positive 
flow </>, we can find a r £ T and a c > such that ct^ < (f>ij, where equality 
holds for at least one edge. It is then easy to deduce that (j> can be written as 
a convex combination <j) — ^2 t c t t, where at most |supp0| coefficients c T are 
non-zero. We also have the following lemma. 

Lemma 3. Let cf> be a circulation free positive flow and ab an edge in the support 
of <fi. There is a r £ T with the property that T a & > and such that 

min^(suppr)>§iHL-^-. 

brnax I SUpp <j>\ 

Proof. Write cj> as a convex combination cp = ^ r c t t of bfss where at most 
I supp 0| of the c T s are non-zero. Hence, 



max{ CrTab ■ Tab > 0} > — =>• C T > 
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supp 0| b* max | supp 0| 

The stated inequality then follows, since positiveness implies that <f> > c t t, for 
all r, and thus 

min0(suppr) > c T ■ min r (suppr) > c T b* min 
by (13). □ 



3.2 Kirchhoff's equations 

Given a weighted graph G = (V,E,£) and a conductivity vector a = (fry) > 
0, we will consider Kirchhoff's equation with flow requirements (a Neumann 
problem) 

L(a)p = b, b£R v (14) 
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and also with voltage prescriptions (a Dirichlet problem) 

(L{<r)p) | ns = 0, p\ s = q\s- (15) 

The orientation of the edges of G are inessential. The equation (15) has a unique 
solution as long as S intersect each component of G. The equation (14) has a 
solution as long as b(W) — for every component vertex-set W of G and is 
unique up to linear combinations of the indicators of component vertex-sets of 
G. In particular, the corresponding cocycles and fields are unique. We say that 
p £ WL V is harmonic outside S if L{a) = b and supp b C S. 

The set of solutions to (15) are denoted T>(a\c, q\s)- The solution space to 
problem (14) are similarly written J\f(a\c, &|s), where supp b C S. For defi- 
niteness, we assume the disambiguation rule that the lowest value for p in each 
component of G is zero and we write p = T>(o~\g, q\s) an d P = A/"(ct|g, b\s) to 
stress that the solutions are assumed to exist uniquely. The vector a should 
have domain containing G and q should be defined on a subset of V(G). For 
the problem (14) we implicitly extend b to V(G) by setting b to zero outside the 
singular set 5* if needed. 

A conductivity vector which at the same time is a minimum cost flow allow 
solutions to (15) and (14) where the corresponding field is constant. 

Lemma 4. Assume a £ is a conductivity vector supported on a graph H 
where all oriented cycles satisfies £(j) = 0. Assume further that S is a subset 
S C V(H ) and that b £ R v is an admissible source vector such that supp b C S . 
If a is a positive flow with Ba = b then 

(a) the solution p = Af(a\n ,b\s) is given by^>{p) = 1. 

(b) if *(p) ee r, r > 0, then p = T>(a\ H ,p\ s ). 

Proof of Lemma 4- By assumption, £ is orthogonal to all oriented cycles and is 
thus a cocycle. Hence, there is a vector p £ R y ( ff ' such that ^(p) = 1. The 
first statement in the lemma then follows since 

L{a)p = B ■ diag(cr) • *(p) = Ba = b. 

The potential p is essentially unique since supp b must intersect all components 
of H = supp a. 

The second statement follows by the same reasoning since supp b C S and 
the obtained p is thus harmonic outside S. □ 

The following elementary, but crucial, lemma expresses the continuity of the 
solutions in KirchhofFs equations. Assume a and a are two conductivity vectors 
on the connected digraph G = (V, E) where we assume that supp cr — E and 
where H C G is the graph induced by supper. Consider two cases 

(D) p = V(a\ G ,q\ s ) and p - V(a\ H , q\ s ), S C V(H). 

(N) p = N(o-\ G ,b) and p £ N{o\ H ,b\v{H)), where S :=supp6c V(H). 
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Lemma 5. For the solutions p and p in both cases above, define 

p := V(<t\ g ,P\v(h))- 

Let 

o{o-,a) := ; — . 

mm + a 

where min+(a; ct ) := min{x Q : x Q > 0}. Then 

||p-p||oo = OW||oo) 

as <5 -> 0. 

3.2.1 Proof of Lemma 5 

Let ip = *(p), ip = fy(p) and $ = ^(p). Notice that ipij = ipij, for ij £ H. Let 
r := p — p, and p := ^(r) = ip — ip. 

We expand aip 2 = cr(ip — p) 2 and obtain 

£(cnp 2 ) = £(a^ 2 ) + £{ap 2 ) - 2£(paip). (16) 
Similarly, since ip = ip + p, we obtain 

£{ai\?) = £(&^ 2 ) + £{ap 2 ) + 2£{pa^), (17) 
Let e = a — a. Adding (1G) to (17), and rearranging the terms gives 

I (e(^ 2 - i> 2 )) = t ((2a - e)p 2 ) + 2£ {p{cj> ~ $j) (18) 

where <p = aip and <f> = aip. Both <p and <p are currents with sources contained 
in 5 and the last term in (18) 

£ (p{<j> - 0)) - r T (0 - <£) = 

vanishes. To see this, note that the Dirichlet case (D) implies that r = p — p is 
zero on supp B(<fi~ <p) C S. In the Neumann problem (N), B{<p — <p) =6 — 6 = 0, 
since <p and are flows with source vector b, by assumption. 

Hence, after some more rearranging and using that ip 2 — ip 2 = p(ip + ip) we 
obtain from (18) the equality 

t{°P 2 ) = \l (p<i> + V> + p)) = t(peiP) (19) 

Since r equals p — p on V(H) and since r is harmonic outside V(H), we 
have ||r Hoc = ||t| ||oo by the maximum principle (e.g. [7]). Moreover, since 
p = il?(r) and since, by assumption, rk — for some vertex k in each component 
of H, we have, for any i £ V(H) that 

n = n -r k = e(irip), 
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where 7Tj is a vector representing some oriented path connecting i with the 
grounded vertex k. The Cauchy-Schwarz inequality then implies that 



\\r\li, = max (ifa)) < diamff • I [p* H J , (20) 

where diamif denotes the length of a longest shortest path in H. 
It follows from (20) that the left hand side in (19) 



£(ap 2 ) > (min+ <r) • i (pf H ) 



mm_i_ a 
> „ • r 
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diami? 



By Cauchy-Schwarz, the right hand side of (19) 



which gives 



i{p*i>) <^-\g\- \\tp\u ■ 

mini: 



l(f**l>) < . ll^l^ . || p || t 

mini: 



since ||^(u)|| 

OO 

< 2\\u\\ 

Hence, by comparing sides in (19), we obtain, after dividing both sides by 
(diamiJ) /(HrHoo min + a), that 

IH|oo< (MG\-^?-)-6-\\p\\«>. (21) 



where S = ||e||oc/ min + a. 

It just remains to verify that |]jj]]oo = O(||p||oo): In case (D) it follows 
immediately that ||p||oo = ||j>||oo by the maximum principle. In case (N), we 
have a > (1 — 5)a. The solution to the Neumann problem with conductivity 
(1 — 5)a is given by p/(l — 5) and we deduce from Rayleigh's monotonicity 
principle ([7]) that < ||p]]oo/(l - 6). □ 



3.3 The construction of (H*,p*) in Lemma 1 

Given a pair (H , p) , where H is a subgraph of the weighted digraph G = (V, E, £) 
and p S K^'" is a potential on if, we say that a directed path n C G with 
endpoints {a, 6} C F(ff) has (p-j sZope r(p;n) = {p a — pb)/£(n). Note that, the 
slope along a directed path in H is a weighted average of the slopes of arcs along 
the path, i.e. 

r(p; tt) = M n (tp) := -L *(tt^) (22) 

where -0 = ^(p) is the field on H corresponding to p. We use tt to both denote 
the directed path and the corresponding vector > in R E . 

The p-slope is constant on the path tt C H if i/V, = r(p; 7r) for all arcs ij G 7r. 
A directed fcZ-path 7r C G is a directed trajectory to a connected subgraph H <Z G 
if both endpoints, and I, of 7r belongs to V(£T) and all internal nodes are in 
V(G)\V(H). 
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To construct the graph H* and p* , we consider a given pair {H, p) where H C 
G is a connected subgraph and p £ R y ( ff ) is a potential on H. Initially, we have 
(H,p) = (H,p) and we iterate the elementary extension (H',p') of (H,p) defined 
as follows: Let tt denote a directed trajectory to H having maximum positive 
slope r = r(p, tt) > 0. Let H' = H U tt and extend p to p' by requiring that p' 
has constant slope on tt. In the case we have many paths of the same maximum 
slope, we pick the first path in some lexicographic order. If no trajectory of 
positive slope exists then we stop and set H* = H and p*\v(H*) = P- 

The construction ensures that the slope of extension paths will decrease in 
value: If (H',p') has a trajectory tt' such that the p'-slope exceeds r then tt 
can not be a trajectory of maximum slope to (H,p). To see this, let tt" be the 
unique trajectory to H that contains tt' and note that the p-slope of p" equals 
it p'-slope; which is obtained as an average of the p'-slope along sub-paths of tt 
and tt' and would thus exceed the p-slope of tt, contradicting the choice of tt as 
a trajectory of maximum slope. 

Furthermore, the p-slope along any if -trajectory, tt, with endpoints a, b € 
V(H), must be strictly less than 1. Otherwise tt can be extended to an oriented 
cycle 7, with tt as a positively oriented subsegment and j\tt an oriented 6a-path 
in H. Thus, 

= £{tt) + £(~f \ tt) = £(tt) - (p a - p b ). 

If r(p; tt) > 1 then < and 7 is an augmenting negative- or zero-cost cycle 
contradicting the choice of H. 

The constructed extension clearly maximises S(p* , H* , A) for large A, since 
it is easy to see that F r = contains all edges contained in some 

H r = (p*)~ 1 (r, oo)-trajectory of slope r: If we inductively assume that the 
extension to H r is maximising — which is trivial when H r = H — then, so, is 
the extension to H r U F r , since r and then \F r \ are maximal. 

3.4 The proof of Theorem 1 
3.4.1 Some relations and identities 

We first state some more equivalent formulations of the adaptation rule given by 
(8) and (9): By multiplying (8) with the integrating factor e* and then integrate, 
we obtain 

a(t) = (1 - e-*)<£(t) + e"V(0), (23) 
where <f>(t) £ $ is the discounted time-averaged flow 




That <p(t) £ M. E is a flow follows from the convexity of $(&, G). 
If we integrate (9), we derive 

a{t) = a(0) e-W- l)t . (25) 
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where 

1 r* 

Pit) ■= ~ t J o P(s)ds, (26) 

and ijj(t) = ^(p(t)) is the time average of ip(t). 

For a flow obtained as a current in an electrical network, the flow is always 
from higher potential to lower potential. Thus, if is a current then each arc ij 
is contained in the cut given by S = {k : pk > max{pj,j)j}} and the flow across 
this cut is from S to V \ S only. Hence, 

\^\<b* max (27) 

Since <fi in (23) is an average of the currents 4>(s), s < t, we deduce that con- 
ductivities stay bounded 

a(t) = (1 - e-*)0(i) + e-V(O) < K := b* max + maxa(O). (28) 

(We will label constants K\, K2, ■ ■ ■ and c\, c%, ) 

Since <Jij(t) > 0, we also obtain that 

e - * 

min0y(t) > -tr(0) ■ ^ (29) 

which means that the flow 4>ij(t) is "almost positive" for large t. Let therefore 
f(t) be the non-circulatory positive flow f(t) £ $ + obtained from (/>(i) by the 
application of Lemma 2 with respect to arc-set 

E := {ij : 4> t3 {t) < 0} U {ij : $ y (t) < 0}. 

The flow /(i) is non-circulatory, since ipij(t) < for at least one ij along 
any directed cycle. Lemma 2 in conjunction with (29) and (25) gives that 
f(t) = <j>(t) + 0(e"*) and we deduce from (28) that 

a(t) = f(t)+0(e- t ). (30) 

Hence, there is a constant K\, such that 

<2/y(*) whenever <7y(t) > J^e - *. (31) 

The observation (34) below is in some sense the key to the proof of Theorem 1 
and the statement is essentially the same as that given in by Onishi et al. in 
[18]. Let 

£(<):= log (cr(t)/<r(0)). (32) 
Let 7 = 7 + — 7" £ M. E be fixed. Applying £(-7) on both sides of (25) gives 

I (£(*)7) = (* - %)) t - £(7) *. (33) 
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After dividing by — jjh=\ an d rearranging, we obtain 

M 7 - (£(t)) = r ■ M 1+ m) + (r - 1) t - t (34) 
where r(-f) := / and M 7 (x), 7 > 0, is the weighted mean 

If 7 G $(0, G) is a circulation, then i (jp(t)j) = and we obtain 

M 7 - (£(*)) = r • M T+ (£(*)) + (r - l)t (35) 
and if 7 = — 71", where 7r is a directed a6-path, we obtain 

Af,(f(t)) = i(M^(t)) - 1) = t {^j^ (36) 
3.4.2 The proof of Theorem 1 

Let kl G G\H. Using (35), we show below, for some a\ > 0, that 

<Tkl(t) <0(e- ait ), Vfc/GG\i? (37) 

It follows from (37) and Lemma 2 that we can write the circulation free positive 
flow f(t) as f(t) = f(t) + 0(e~ ait ), where f(t) is an optimal flow supported on 
H. (Recall that any such flow is optimal.) 

Hence we have from (30) the decomposition 

a(t)^f(t)+0(e-^). 

We also show below that 

Ai(t) = fl(l), VijeH. (38) 

The conditions of Lemma 5 are now fulfilled for a = a(t) and a = f(t). 
Moreover, Lemma 4 implies that the solution p = A/"(/(t)|jj, b\jj) is constant 
and given by ^^(p)^ — = 1, ij G H. The estimates (37) and (38) shows 

that we may take 5(f(t),a(t)) = 0(e~ ait ) in Lemma 5. Thus, we obtain from 
Lemma 5, that Vie V(H), pi(t) = p t + 0(e~ ait ) or, equivalently that 

^■(*)=C-+0(e-° lt ) ) ViyGiT, (39) 



where ipij — 1 for ij G H. 
Write 



V>ii(i)=V>y+£iiW- 
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As a direct consequence of (25), we have 

a ij (t) = (l-e ij (t))-a* j -e^-^ t (40) 
where a* > is the constant vector 



a* := er(0) exp (^J e(s) ds^j . 



and 

e(s)ds > — 1, 



e(i) = exp 



since the integrals are convergent by (39). We obtain from (40), for ij 6 H, 
that 

lim a(t) = lim f(t) =06$. 

and that \<r(t) -$\ = 0{e' ait ). 

For ij £ ff , the exponential convergence of 

hm^y(i) = lim(o-jj (f)V«(*)) = (lim cry (t)) • 1 = 
follows. For ij if, we have on account of Ohm's law and (37) that 

I'M*) I <K a {t)-*ij(t) =o( e - ait ), 
where, due to the maximum principle, we can take 

„ M . max tJ s sup pb \ Pi (t) -Pj(t)\ 

K 3(t) ■= — e ■ 

mint: 

The numerator is stays bounded and is for large t at most diamiif since ip(t) 
converge to 1 on H. □ 

Proof of (37). Using Lemma 3 on the circulation free flow f(t) and taking the 
(30) into account, we deduce the following: There is a constant C3 such that, 
for any given edge ij, either cr^ < Kie^ 1 or else there is a r = r(t) £ T such 
that nj > 

mincr(suppr) > c^Uij. (41) 

(We suppress the time variable for readability.) 

As before, let £(t) = log (a(t)/a(0)) . With kl 6 G \ H as in (37), either 
o~ki{t) < K\e~ l in which case we are through. Otherwise, there is a bfs n such 
that 

M T1 (£(t)) > min£(supp n) > log a kl (t) + log K Ai (42) 

where = C3/ maxcr(O), with C3 as in (41). 

Let T denote the set of basic optimal solutions, i.e. feasible solutions sup- 
ported on forests contained in H. If t-i £ T then we can apply (35) on the 
circulation 7 = t-i — n and deduce from (42) that 

log a u (t) < rM T2 (£(t)) - (1 - r)t - log tf 4 , (43) 
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where 

r = l{T 2 )/£(n) < max ^2 =: i _ < L 
Moreover, from (28), we know that M T2 (£(£)) < logi-Toj whence 

\oga k i(t) < (1 - on) log If - aif - logi^, 

which proves (37). □ 

Proof of (38). Clearly, we have for all t > that maxy /^(i) > ^max/l^l' ana ^ 
hence, by (41), there is, for all t, some To = 7o(i) G 7" such that 

M ro(t) (£(i)) > log (C^/I^Q + logc 3 - maxloga(O) =: logc 6 . 

Choose Ti G T arbitrary. If we apply (35) on the circulation 7 = 7(i) = To(i) — t\ 
we get 

M n (£(f)) > r • logc 6 + (r - l)t > logc 6 . 

since, in this case r > 1 on account of ti being optimal. Since £,ij(t) < log-Ko, 
for all ij, by (28), it follows that 

■ \ ^ l(n) ■ (logc 6 -logifp) 

mm £(supp n ) > — . 

mint 

This proves (38), since n was chosen arbitrary among basic solutions with 
support in H. □ 



3.5 The proof of Theorem 2 

Since H is connected, the construction of p* as in section 3.3 goes through. Let 
iP*(H*) = {r , ri ,...,r M }c(Q,l], (44) 



denote the slopes obtained by p* on H*, where 1 = Vq > r\ > ■ ■ ■ > tm > 0. 
Let further r M +i = 0. For r = r k > 0, let F r = (-0*) _1 (r), H r := U s>r F s and 
Fq := G\ H* and Hi the empty graph vertex-set suppfe. Note that F\ = H 
and that H r is connected for r < 1 and that i/o = il*. 

Assume that r = G ip*(H*) is fixed. We simplify the notation by putting 
# = H r , F = F r . We let r' = r k+l < r and put H' = H r > = H U F. We prove 
Theorem 2 with an induction argument over k = 1,2,... using the induction 
hypothesis that, for some constants a k > and C k > 0, 

\Pi{t)-pt\ <C k -e- a *\ VieV(H r ). (45) 

This is shown to hold for r = n (k = 1) on account of (39) in the proof of 
Theorem 1. The induction step comprise of showing that, for r > 0, we can 
extend (45) to hold for i G V(F r ) for some constants a k +i > and C k +i > 0. 
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The following two relations, (46) and (47), takes us a good way through the 
induction step. Let = log (a(t)/a(0)) . If r > then 

&(t) = (r-l)t + 0(l) (46) 

for all ij G F and 

&(*)<(r'-l)t + 0(l), (47) 

for ij G G\H'. We defer the proof of these two claims to the end. 

We use Lemma 5 together with (46) and (47) to conclude the proof. We 
want to show that 

P (t) =v(a(t)\ G ,p(t)\v(H)) , 

satisfies \ P i(t) - p*\ = 0(er ak+lt ) for i G V(H'). Since i/j*\f = r is a constant 
field, we know that F = W \ H contains only zero-cost oriented cycles. Hence, 
by Lemma 4, 

p*\v(H')=v(f'\ H ,, P *\ v{H) ), (48) 



where fit) G $ + (6) is the flow supported on H' obtained by applying Lemma 2 
and removing the arcs G\H' from the positive flow f(t) in (30). If we let 

q{t)=v(a{t)\ G ,p*\ v{H) ), (49) 

then \pi(t) — qi(t)\ < 0(e~ akt ) for i S V(H'), by the maximum principle and 
the induction hypothesis (45). It is therefore enough to show that 

\q i (t)-p*\=0(e- a ^ t ), VzeV(F). (50) 

By (47), (30) and Lemma 2, 

\\f(t)-a(t)\\oo = 0(e^-^). (51) 

and by (46), (30) and Lemma 2, 

fij (t) = Qie^- 1 ^) + Oie^'-V 1 ) = 9( e ( r - 1 ) t ), (52) 

for ij G H'. It follows that the conditions of Lemma 5 are fulfilled for the 
solutions in (49) and (48) with a = <j(t) and a = fit) and 

S(a(t)\ G ,f'\ G ) = 0(eM-(r-r')t}), 

and thus we can conclude from Lemma 5 that (50) holds with 

a k+ i = min{a fe ,r - /}. 

□ 
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Proof of (46) and (47). Integration gives that if \p 2 (t) - p*\ = 0(e~ afct ) then 

\p i (t)-p*\ = 0(l/t). (53) 

We first show that 

&j(t) < (r- l)t + 0(l), for ally e G \ H. (54) 

Given kl £ G \ H, we obtain either that £jy(t) < — i + 0(1), or else, by (41), a 
basic solution r = r(t) £ T such that tu > and 

minC(suppr) > &,(<) + 0(1). 

The forest r contains a unique directed afr-path 7r containing fcZ with endpoints 
a, & in i? and internal vertices in G\H . Then (36) and (53) gives that 

£«(*) < M„(0 + 0(1) = t(^f " 1) + 0(1) 

= t(4p^-i) + *o(i/*) + o(i) 

£(tt) 

< t(r - 1) + 0(1), 

since, by the construction of H — H ri we know that tt has p*-slope at most 
r = rfc. This shows (54). 

Furthermore, it follows by the construction of F = F r that, if ij £ F, then ij 
is the endpoint of an a6-path ir, a,b <E V"(iJ), which has p*-slope exactly equal 
to r. Thus the p(*)-slope of ir equals r + 0(l/t), by (53). But, by (25) and (54), 

i>ij =Sa(t)/t+l<r + 0(l/t), 
and since the p-slope of ir equals the average 

we obtain 

$V >r + ^-0{l/t) = r + 0(l/t), VijGTr. 

Together with (25) and (54) this shows (46). 

It also follows that 4>ij{t) — r + 0(l/i) for £ F. Hence, 

ft(t) = p* + 0(1/ 1) for t e V(H'). (55) 

Hence, we can use the same argument as for (54) to deduce (47), since that 
argument only used (53) which can be replaced by (55). □ 
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